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1. (Previously Presented) A multimedia data structure used for an image 
search, comprising: 

(a) information describing at least one feature of a certain image; 

(b) recent user feedback information based on user relevance 

feedback; and 

(c) whole feedback information based on the user relevance 
feedback obtained since formation of the data structure. 

2. (Previously Presented) The multimedia data structure as claimed in 
claim 1, wherein the recent user feedback information is determined for a 
predetermined time period or by a predetermined frequency. 

3. (Previously Presented) The multimedia data structure as claimed in 
claim 1, wherein the recent user feedback information includes a weight value learned 
by the user relevance feedback or similar image information, and the whole feedback 
information is represented by a weight value learned by the user relevance feedback 
given since formation of the data structure. 

4. (Original) The multimedia data structure as claimed in claim 1, further 
comprising recent user feedback reliability information representing how reliable the 
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recent user feedback information is, and whole feedback reliability information 
representing how reliable the whole feedback information is. 

5. (Previously Presented) The multimedia data structure as claimed in 
claim 4, wherein the recent user feedback reliability information is expressed by 

J 

N 

where, N is a number of user feedback responses, m is a number of images in a 
similar image list, and ni is a number of user feedback responses given to the i-th 
image. 



6. (Cancelled) 



7. (Previously Presented) A method of managing image information for 
an image search, comprising: 

forming a data structure which includes information describing features 
of a certain image, recent user feedback information, and whole feedback 
information; and 

determining weights for the features of the certain image based on the 
recent user feedback information and the whole feedback information, 
wherein the method further comprises: 
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representing the recent user feedback information by a similar image 

list, and 

reflecting a recent user feedback pattern based by the similar image list 
using a queue algorithm, and 

wherein the queue algorithm comprises: 

(a) checking whether a similar image exists in a current queue when 
the similar image is fed back; 

(b) if it is checked that the similar image does not exist in the 
current queue, inputting the similar image to an uppermost space of a queue entrance, 
setting number of feedback responses of the similar image to "1", and shifting images 
existing in the queue to low positions by one space; 

(c) if it is checked that the similar image exists in the current queue, 
increasing the number of feedback responses of the similar image, and shifting other 
images in the queue to upper positions by "N"; and 

(d) if any image is shifted to a lower position over a size of the 
queue at the respective steps, deleting the image shifted to the lower position from 
the queue. 



8. (Previously Presented) The method as claimed in claim 7, wherein "N" 
is fixed or variably determined in accordance with the similar image . 
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9. (Previously Presented) The method as claimed in claim 7, wherein "N" 
is varied in inverse proportion to a frequency of appearance of the similar image. 

10. (Previously Presented) The method as claimed in claim 7, wherein if 
the similar image does not exist in the queue when the similar image is fed back, the 
similar_image is inputted to the queue only in case that the similar image is fed back 
more than a specified threshold number. 

11. (Previously Presented) The multimedia data structure as claimed in 
claim 1, wherien the recent user feedback information is represented as a similar 
image list, and the similar image list has an image list structure which includes a 
similar image identification, a score reflecting the current feedback, and a waiting 
duration representing a time period between a final feedback time point and a present 
time point. 

12. (Previously Presented) A similar image list managing method for the 
multimedia data structure recited in claim 11, comprising: 

managing a similar image Ust in a manner that only images whose 
scores are over a predetermined threshold number are maintained in the list, or only 
images whose scores are on N upper positions of die list if a size of the list is N. 
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13. (Previously Presented) A feedback reflecting score updating method 
for the multimedia data structure recited in claim 11, comprising updating image 
scores in a manner that: 

(a) with respect to images fed back from similar images, a following 
calculation is performed: Score (new) - Score (current) x fW (Waiting Duration) + 1; 
and 

(b) with respect to other images not fed back, a following 
calculation is performed: Score (new) = Score (current) x fW (Waiting Duration) ; 
and wherein fW (Waiting Duration) is a function having a characteristic that it returns 
smaller values as the waiting duration becomes longer. 

14. (Previously Presented) A method of determining weights of image 
features used for an image search based on user relevance feedback, comprising: 

(a) providing a multimedia data structure including information 
describing features of a certain image, recent user feedback information for the 
image, and whole feedback information for the image based on user relevance 
feedback obtained since formation of the data structure, and reUabiUty information 
corresponding to the recent user feedback information and whole feedback 
information; 
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(b) updating the recent user feedback information and whole 
feedback information and their reUabiHties by learning them in response to the user 
relevance feedback; 

(c) determining weights of image features in proportion to the 
reliabilities of the recent feedback information, the whole feedback information, or 
both the recent feedback information and the whole feedback information. 

15. (Previously Presented) The method as claimed in claim 14, wherein the 
recent user feedback information is represented by a weight value learned by the user 
relevance feedback or a similar image information, and the whole feedback 
information is represented by a weight value learned by feedback given since 
formation of the data structure. 

16. (Original) The method as claimed in claim 14, wherein the reliability of 
the recent user feedback information is determined in proportion to a consistency of 
a recentiy used pattern or feedback. 

17. (Previously Presented) The method as claimed in claim 14, wherein the 
reliability of the whole feedback information is determined in proportion to a number 
of feedback responses concerned in learning. 
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18. (Previously Presented) The method as claimed in claim 14, wherein the 
reliability of the whole feedback information is responsive to recorded user usage 
records wherein the recorded user usage records provide feedback to the reliability of 
the whole feedback information without user interaction. 

19. (Previously Presented) A multimedia data structure reflecting change of 
a user relevance feedback for determining weights of image features used for an 
image search, comprising: 

(a) information describing at least one feature of a certain image; 

(b) recent user feedback information based on user relevance 

feedback; 

(c) whole feedback information based on the user relevance 
feedback obtained since formation of the data structure; and 

(d) reliability information indicating reliability of at least one of the 
user feedback information and whole feedback information. 

20. (Previously Presented) The multimedia data structure of claim 19, 
wherein the reliability information indicates reliability of both of the user feedback 
information and the whole feedback information. 



8 



Serial No. 09/666,281 Docket No. HI-019 

Amdt. dated April 29. 2004 

Reply to Office Action of January 14. 2004 

21. (New) The multimedia data structure as claimed in claim 1, wherein the 
recent user feedback information and whole feedback information provide an 
indication of relevance of said information describing the at least one feature of the 
certain image. 

22. (New) The multimedia data structure of claim 1, wherein the at least 
one feature includes at least one of a color histogram, a texture histogram, and a 
dominant color of the image. 

23. (New) The multimedia data structure of claim 1, wherein said 
information provides a statistical description of the image. > 
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